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SPECIFICATION 

TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN, that Michael R. Abato, a citizen of the United States and a 
resident of the State of New York invented certain new and useful improvements in: 

A SYSTEM AND PROCESS FOR CREATING A 
VIRTUAL STAGE AND PRESENTING 
ENHANCED CONTENT VIA THE VIRTUAL 
STAGE 

of which the following is a specification. 
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REFERENCE TO RELATED APPLICATIONS 

This application claims priority to and incorporates by reference, in its 
entirety, U.S. provisional application serial number 60/269592, by Michael R. Abato, 
entitled "A SYSTEM AND METHOD FOR PRESENTING CONTENT RELATED 
5 TO A TEMPORAL EVENT TO A USER VIA A VIRTUAL STAGE" which was 
filed on February 15, 2001. The present application is also related to the following 
applications, which are incorporated, in their entirety, herein by reference: U.S. 
application serial number 09/396,693 of Craig D. Ullman, Michael R. Abato, Jeffrey 
M. Harrington, and Carl R. Duda, entitled "ENHANCED VIDEO PROGRAMMING 
10 SYSTEM AND METHOD FOR PROVIDING A DISTRIBUTED COMMUNITY 
NETWORK," and filed on September 15, 1999 (hereafter, the "DCN application"); 
and U.S. provisional application serial number 60/269,593 of Jeffrey M. Harrington, 
entitled "A SYSTEM AND METHOD FOR SERVER SIDE CONTROL OF 
FLASH," and filed on February 15, 2001 (hereinafter, the "FLASH application"). 

15 

BACKGROUND OF THE INVENTION 

Today, the capabilities of computers to provide massive amounts of 
educational and entertainment information has exploded with the Internet. The 
Internet has the power to transform society through unprecedented levels of 

20 information flow between members. Currently, on-line systems offer a variety of 
different services to users, including news feeds, electronic databases (either 
searchable by the user directly on the on-line system, or downloadable to the user's 
own computer), private message services, electronic newsletters, real-time games for 
play by several users at the same time, and job placement services, to name a few. 

25 However, today, most on-line communications occur merely through text. This 
currently stands in great contrast to the audio/visual presentation of the alternative 
electronic medium, television. However, it is expected that as multi-media's 
incessant growth continues, audio/visual programs will proliferate and text will 
become less and less dominant in the on-line environment. Even though these 

30 programs will be introduced, the Internet will remain essentially user unfriendly due 
to its very massiveness, organization and randomness. Simply stated, there is no 
order or direction in the Internet. Specific pieces of information are many times hard 
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to find, and even harder is the ability to put that piece of information into a 
meaningful context. 

Television, on the other hand, has been criticized for being a passive medium- 
"chewing gum for the eyes," as Fred Allen once observed. Television has always 
5 been something you watched, not something you do. Many social critics believe that 
the passivity television depends on has seeped into our entire culture, turning a nation 
of citizens into a nation of viewers. While interactive television systems have 
increased the level of user interaction and provided greater learning and entertainment 
opportunities, vast information resources, such as databases, are inaccessible from 

10 such a medium. 

Recent innovations in combining Internet content with television and other 
audio and/or video programming signals have been described in various patents and 
publications, for example, United States Patent Number 5,778,181, which issued on 
July 7, 1998 to Jack D. Hidary, et al, United States Patent Number 6,018,768, issued 

15 on January 25, 2000 to Craig Ullman and Jack Hidary et al., and also in United States 
Patent Number 5,774,664, which issued on June 30, 1998 to Jack D. Hidary, et al. 
(hereinafter, collectively the "Hidary patents")' The contents of these patents are 
herein incorporated by reference, in their entirety. As is now well known in the art, 
these patents describe innovative systems and processes for combining the user- 

20 friendly visual experience of television programming signals, and other time based 
events or signals, with information resources located on the Internet which relate to 
the programming signal (hereinafter, the "Enhanced Content"). Since segments in a 
programming signal are generally presented in a sequence to a client based upon a 
reference to a known event (for example, the amount of time remaining in a football 

25 game is based upon the kick-off, or the amount of time remaining in a recorded movie 
is based upon when the playback of the movie is started and not when it was actually 
filmed), such programming signals shall herein be regarded as applying to any signal, 
show, or sequence of events, whether pre-recorded or live, which are defined or based 
upon a temporal relationship (hereinafter, the "Temporal Signal"). Such Temporal 

30 Signals may include live events (for example, a cut-away by a television broadcaster 
to a then breaking news event), pre-recorded events, and combinations of live and 
pre-recorded events. 
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Recently, various approaches have been implemented for providing client side 
and server side systems capable of providing Enhanced Content related to a Temporal 
Signal. As is well known in the art, such approaches generally require a client to 
download (commonly from an Internet based Web site) and then install a Java applet 
5 which configures the client's system as a specific application. Another approach 

utilizes a client system, such as a Web Browser or an equivalent system including, but 
not limited to, a Flash player or an XML browser (hereinafter, collectively, a 
"Browser"), and a downloaded program which configures the client system to retrieve 
u= Enhanced Content over a specific type of communications link, for a specific type of 

S 10 client device, based upon the reception of a Temporal Signal and an address 

SJ identifying a provider of Enhanced Content related thereto. Regardless of the specific 

^ methodology utilized, today's client systems commonly must execute a large 

05 download to receive and present Enhanced Content program segments which relate to 

: 7 a given Temporal Signal. 

15 Further, since the Internet has innumerable sites, which a client may or may 

not find using a search engine, producers of Temporal Signals often identify a 

2; location providing Enhanced Content (for example, an Internet site) by presenting, in 

P 

ffj the video or audio portion of a Temporal Signal, a Uniform Resource Identifier (URI), 

as defined in the RFC 2396 which includes, for example, a tangible Web asset, a 

20 Uniform Resource Locator, a Uniform Resource Name, a functional push and an 
object push (hereinafter, collectively referred to as an "URF). Once the site is 
identified by the client and/or the client's device or system (hereinafter, "client 
device" and "client system" are utilized interchangeably), the client system commonly 
registers the client with the provider of the Enhanced Content. 

25 Following registration, the client often needs to identify a program or segment 

for which the client desires to receive the related Enhanced Content (since Enhanced 
Content for multiple programs may be accessible from a single Internet site). Once 
selected, the client system then often downloads and installs a Java applet, or similar 
program code, which configures the client device to receive the related Enhanced 

30 Content. At this point, the client system is then ready to connect to the provider of the 
Enhanced Content, satisfy any pre-requisites (for example, providing a password, 
sign-on, or user profile information), and receive the Enhanced Content. 
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As such, the approaches commonly utilized today to receive Enhanced 
Content generally require a client to first identify the location of a provider of 
Enhanced Content, register the client with the provider, download a program which 
configures the client system, installs the program, connects to a site providing 
5 Enhanced Content related to a specific Temporal Signal, and then satisfies any pre- 
requisites prior to receiving the Enhanced Content (for example, providing user 
profile information). In short, these approaches require so much time and effort to 
configure the client system and access a provider of the Enhanced Content that many 
u clients are discouraged from utilizing such an approach, 

10 What is needed is a system and process which reduces and minimizes the 

m amount of time and effort required by a client device to automatically, or upon 

f j request, receive Enhanced Content related to a Temporal Signal. What is needed is a 

fp wider, richer, quicker, and more efficient system and process for receiving and 

processing audio/visual and textual database elements into an organized unique 
15 interactive, educational, entertainment experience. 

SUMMARY OF THE INVENTION 

Systems consistent with the present invention provide a system and process 
for combining Temporal Signals (which appear, for example, on a television 
broadcast, a VHS or Beta tape, CD-ROM, DVD, CD, or other medium) with 
20 Enhanced Content (accessible, for example, via the Internet) without requiring 

lengthy downloads, specific client devices or operating systems, specific data formats, 
or similar constraints. By abstracting the concept of a Virtual Stage which contains at 
least a Show Object and a Receiver Object, the present invention allows Enhanced 
Content to be received and processed by virtually any system regardless of 
25 configuration, device, hardware, software, communications links utilized, or 

practically any other factor. Preferably, such a system is implemented on a client 
device capable of hosting a Browser. As such, the present invention is described in 
the context of using a Browser for supporting its operations. 

Further, the present invention creates a new, efficient, dynamic, diverse and 
30 powerful educational and entertainment medium. The system allows consumers to 
receive more information in a more efficient manner than either television or the 
Internet alone and over prior systems and processes utilized to present Enhanced 
Content related to a Temporal Signal. Instead of requiring client systems to execute 
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lengthy, and sometimes problematic, downloads prior to receiving an Enhanced 
Content segment, the present invention streamlines such processes by removing the 
determination of a type of Receiver Object utilized by a client device from the 
initialization processes. As such, by using the new systems and processes, consumers 
5 not only can see a news report on television, but they can also read pertinent 

information about the report, as well as explore related information about the story 
regardless of the device, type of Browser or platform utilized by the client system, 
and/or the source of the Enhanced Content. The act of viewing a program has now 
H become a more engaging, enriching experience, because Enhanced Content can now 

j=g 10 be obtained almost instantaneously without any lengthy downloads, initialization 

y routines, or constraints upon compatible systems or sources. 

fr~ 

Off The systems and processes of the present invention can also create a more 

-J? intimate relationship between the client and the program. For example, in an 

s educational environment, a student (the client) might be solving problems or 

; 5 

15 performing virtual experiments on an Internet site that a teacher is discussing in an 
H educational television program. Similarly, the consumer might be solving problems 

S that the fictional characters in a television program must solve. In both cases, the 

ry consumer is an active participant in the process, rather than a passive observer. 

Unlike previous systems, the present invention enables the student and the teacher to 

20 visit the classroom via any client device, including the ever more increasingly popular 
wireless devices such as personal data assistants and wireless communications 
devices. Such capabilities are possible with the present invention, because the 
invention provides for the creation of an abstraction of a Receiver Object that allows a 
client device (regardless of the device's specific configuration and/or capabilities) to 

25 receive Enhanced Content without requiring those elements responsible for presenting 
the Enhanced Content to know from where and/or how such content was obtained. 
Instead of the entire Browser or a specific application software being concerned with 
when and how Enhanced Content segments are received, in the present invention, 
only an abstracted Receiver Object (i.e., an Application Program Interface (API)) is 

30 so concerned. This enables the Show Object (i.e., another API that is responsible for 
actually formatting and presenting the Enhanced Content to the client) to function 
without concern as to the origin of the Enhanced Content segment(s) to be presented. 
Thus, the abstracted Show Object is much like a car engine in that the engine doesn't 
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care where or how it gets the fuel it needs, it is merely concerned with utilizing the 
fuel made available to it as efficiently as possible while maximizing the performance 
of the car. 

Another advantage of the system is that it changes the nature of advertising. 
5 Since additional information can be now given, via the present invention, to 
consumers automatically and without large downloads. The system enables the 
advertising to be more interactive, responsive, and substantive. Such real-time 
responsiveness allows customers to make more informed and/or spontaneous choices. 
Now, the act of purchasing a product seen on television or listened to via radio or 
S 10 other sound system can be streamlined - the consumer can be given the choice of 

SI buying the product instantly using the two-way capabilities of the system. For 

example, the processes of the present invention enable an Enhanced Content provider 
OB to quickly establish a virtual store on whatever device the client is using. Preferably, 

the client device includes a Web browser, but a Web browser is not required to 
15 implement the present invention. Thus, all that is needed to establish such a virtual 
M ; store, is the configuring of a Virtual Stage and then the pushing or pulling (for 

£ example, in FLASH) of those store elements needed (racks, clothes, cashiers, etc.) 

fU to/by an abstracted Receiver Object which, as directed by the Stage Manager, 

provides the Enhanced Content (for example, in a FLASH format) to an abstracted 
20 Show Object for presentation to the client. 

In addition, users can take advantage of the two-way capabilities of the 
Internet to respond to polls, to send e-mail or to link to additional sites. For example, 
a viewer watching a television news program, through the system of the invention, 
can receive a stream of Web pages (i.e., Enhanced Content) which provide additional, 
25 specific information relating to the news content. Such information might also be 
received as a chat message (provided in any format), which the client device suitably 
processes via the Receiver Object API, the Show Object API and a Subscriber Object 
API (e.g., configured to process chat messages) and suitably presents, via the Virtual 
Stage, to the client. 

30 Further, video programming and corresponding Enhanced Content (which 

may include static or dynamic Internet pages) can be viewed on a personal computer 
equipped with a television card and a Browser. The Virtual Stage approach, which 
utilizes a Show Object API and a Receiver Object API in the preferred configuration 
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in conjunction with a Browser to create a Virtual Stage, enables any suitably 
configured client device to receive a Temporal Signal and Enhanced Content via a 
Virtual Stage, regardless of the device or the communications medium utilized. 

By simplifying those systems and processes needed to marry the appeal of 
5 Temporal Signals (for example, a video signal) with the two-way data transfer 

capabilities of the Internet, a powerful new medium is created which allows producers 
of Temporal Signals and creators of Enhanced Content to combine their mediums and 
content without concern as to where, when or how such Enhanced Content will be 
received and/or processed by a client device. Such capabilities will allow advertisers 
J? 10 to extend their brand identity and differentiate their program offerings to the millions 

SI of people who may not have a Web enabled television or a home personal computer 

2^ but are equipped with a wireless Personal Data Assistant (PDA), telephone, pager, or 

ffl similar device which can be configured to support a Virtual Stage. In addition to 

providing significant and immediate benefits to broadcasters and advertisers, the 
y 15 system will also present educational programmers with a way to more effectively use 

Internet resources in a classroom which is not bound by physical and/or temporal 

Jr 

constraints. 

fy Additionally, just as a Receiver Object API, a Show Object API, and other 

elements (for example, a Subscriber Object API) are utilized to create a Virtual Stage, 

20 an abstraction of a location providing Enhanced Content (i.e., a Virtual Site API) is 
also provided for by the extension of the client side processes to the server side. The 
Virtual Site API makes possible the creation of playlists (which identify those 
Enhanced Content segments that are to be synchronized with or are somehow related 
to a Temporal Signal). Further, the Virtual Site facilitates the creation of playlists 

25 without concern as to how, when, or where an Enhanced Content segment will be 
communicated to the client device. The Virtual Site allows programmers and other 
Enhanced Content creators to focus merely upon the creation of programs and related 
Enhanced Content. The Virtual Site also enables a producer to access Enhanced 
Content segments, regardless of the origin, and then reconfigure such segments into a 

30 format supported by a particular communications medium and/or client device. Thus, 
when a Virtual Site is utilized, two different classifications of personnel may be 
utilized to create and present Enhanced Content related to a Temporal Signal. These 
classifications are: programmers/content creators, who create the Enhanced Content 
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segments based upon a Virtual Site; and producers, who control the Virtual Site such 
that the Enhanced Content, regardless of origin or format, is appropriately configured 
and transmitted to a client device over a given communications link. 

For example, a programmer creates a playlist for a game show question and 
5 answer segment (i.e., the Enhanced Content segment) based upon an abstraction of a 
transmitting site, i.e., a Virtual Site. The game show segment is then provided to the 
producer who determines (in advance of the Temporal Signal or on a real-time basis) 
that client devices will/are request(ing) access to the Enhanced Content segment via 
M= the Internet, a direct cable modem link, and/or a wireless link and that the segment 

2 10 will be presented to the client via a PDA. Instead of having to create a playlist for 

2f each of the above types of communications links, the programmer can create one 

ffk playlist of segments which are directed towards the Virtual Site. The segments are 

*2? then converted by the producer, as necessary, into a format compatible with each type 

s of communications link and/or device over which requests for the Enhanced Content 

St 15 segment are received. 

\ y 

H : Thus, the present invention provides abstractions of a Virtual Stage and/or a 

5 Virtual Site. The Virtual Stage enable clients to receive Enhanced Content segments, 

fU preferably via a Browser provided on their device, without experiencing lengthy 

downloads and initialization sequences. Similarly, the Virtual Site enables 
20 programmers and creators of Enhanced Content to create segments without concern as 
to the specific communications links or client devices utilized to receive the segments. 
BRIEF DESCRIPT ION OF THE DRAWINGS 

Figure 1 is a diagram of a prior art system design showing the receipt and 
decoding of video signals at the subscriber location. 
25 Figure 2 is a diagram showing an alternative prior art system embodiment to 

achieve the integration of the Enhanced Content with the Temporal Signal (as 
represented by a video signal) by decoding a URI at a server site and then transmitting 
the URIs to the subscriber client devices via the Internet. 

Figure 3 is a flow diagram of the basic software design utilized in the prior art 
30 to provide Enhanced Content related to a Temporal Signal to a client devices. 

Figure 4 is a diagram showing another prior art system which provides for the 
direct transmission of URIs over the Internet to the client devices at a broadcaster's 
entered time without encoding the URIs into the VBI. 
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Figure 5 is a diagram of another prior art system which utilizes a digital cable 
box as an element of a client device for presenting Enhanced Content related to a 
Temporal Signal. 

Figure 6 is a diagram of another prior art system which utilizes a digital 
5 television as an element of a client system for presenting Enhanced Content related to 
a Temporal Signal. 

Figure 7 is a diagram of a prior art distributed communications server 
embodiment for providing Enhanced Content related to a Temporal Signal to a client 
device. 

10 Figure 8 is a flow diagram illustrating the process by which a Virtual Stage 

and Enhanced Content is presented to a client via a client device for a preferred 
embodiment of the present invention. 

DETAILED DESCRIPTION 

As discussed above, the present invention includes a system and process for 

15 providing Enhanced Content related to a Temporal Signal to a client device without 
requiring lengthy downloads and/or timely initialization sequences. The system and 
process may be implemented on any client device or system capable of receiving 
Enhanced Content related to a Temporal Signal. For purposes of illustration, such a 
system and process is described in relation to a system and process configured for 

20 communicating Enhanced Content related to a Temporal Signal as disclosed and 
discussed in the previously identified Hidary patents, the DCN application and also 
the FLASH application, the text of some of which are explicitly incorporated herein 
(for purposes of clarity) and otherwise incorporated by reference. 

As discussed in the previously mentioned references, a system for combining 

25 the rich visual capabilities of video with the vast resources of the Internet is shown in 
Figure 1. As shown, such a system is preferably a computer based system which 
receives a Temporal Signal (for example, a video program) along with embedded 
URIs, which direct the client's device 16 (for example, a personal computer or other 
device capable of receiving Enhanced Content) to address locations, or Web sites, on 

30 the Internet 20 to retrieve at least one Web page associated with the Enhanced 
Content that relates to the Temporal Signal. The particular Temporal Signal may 
include, but is not limited to, audio, video, textual, graphic, and virtual segments, and 
may be delivered in any format, for example, analog, digital or digitally compressed 
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formats (e.g., MPEG 2, MPEG 4 and MPEG 7) via any transmission means, including 
satellite, cable, wire, television broadcast, wireless network, or via the Web. 

The Temporal Signal is preferably created at a centralized location (i.e., 
content creation 4 as shown in Figure 1) for distribution to clients at any location 
5 where a client device 16 can receive a Temporal Signal (for example, in their homes, 
car or via wireless device). Creation of the Temporal Signal is accomplished 
according to any conventional means known in the art. After a Temporal Signal is 
created, URIs identifying Enhanced Content related to the Temporal Signal are 
H= embedded into the Vertical Blank Interval (VBI) of the video programming segment 

q 10 of the Temporal Signal by, for example, the URI encoder 8, as shown in Figure 1. In 

S s this embodiment, the URIs are encoded onto eight fields of line 21 of the VBI. Line 

p 21 is the line associated with close captioning, among other things. However, the 

URIs could also be embedded in other fields of the VBI, in the horizontal portion of 
s the video, as part of the audio channel, in any sub-carrier to the video or, if digital, in 

15 one of the data fields. 
H 1 Although Figure 1 shows the video with URIs over the same transmission line, 

5 the URIs can be sent to a client device 16 independently of the Temporal Signal (and 

til independent of the video programming segments) on a separate data channel. In this 

embodiment, the URIs can be forwarded to the remote sites either prior to initiation or 
20 during the program. Preferably, the URIs have associated time stamps which indicate 
to the subscriber stations when, during the Temporal Signal, to present the particular 
Enhanced Content addressed or associated with the Temporal Signal to the client 
device. Alternatively, client can select when to call the particular Enhanced Content 
for presentation with the Temporal Signal (for example, a presentation of a Web page, 
25 a FLASH page, or any other segment at a specific time point during a video program). 

Once the Temporal Signal is created, it can be transmitted to client devices 16 
over any transmission means including broadcast, cable, satellite, wireless, or 
Internet. Further, the Temporal Signal may reside on video servers, be presented live, 
or even contain, in whole or in part, pre-recorded signals, for example, those provided 
30 on a VHS or Beta tape, DVD, CD, memory stick, or other medium. 

Preferably, each receiver station comprises any Intel x86 machine (preferably 
a 486 processor, Pentium processor, etc.), an Apple Computer, UNIX or any other 
type of generic purpose workstation or standard computer workstation. Those skilled 
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in the art appreciate that as the miniaturization of electronic computing devices 
(specifically computer workstations) continues, such devices may become available in 
various configurations of size, shape and capabilities. Thus, the client devices 16 
capable of utilizing the present invention are not to be construed as being limited to 
5 any specific embodiment of a computing device. As such, any device capable of 

presenting the Enhanced Content may be utilized to provide the features and functions 
of the present invention including, but not limited to, a personal computer, a computer 
workstation, a wireless personal computer, a PDA, a wireless communications device, 

5 s a main frame computer, and any other device capable of receiving Enhanced Content 

D 10 and/or a Temporal Signal. 

5 In the embodiment shown in Figure 1, the client device 16 is preferably 

%p connected to either a cable and/or broadcast television connection or to a local VCR 

m or other video source. At each client site, the client device 16 preferably receives the 

^ Temporal Signal by a cable connection. The video/audio program can then be 

□ 15 processed for display on a video screen using known in the art systems. For example, 

in a personal computer embodiment, any conventional PC card capable of displaying 
4S NTSC signals on a computer monitor, such as a WinTV card may be used. In 

S addition to the cable connection, however, an Internet 20 connection is also provided 

concurrently with the cable connection. 
20 The Internet 20 connection can be via any systems, devices, methods, or 

mediums capable of establishing communications between a client device and an 
Internet server including, but not limited to, high-speed lines, radio frequency signals 
conventional modems or by way of a two-way cable carrying the video or audio 
programming. The client device 16 has Internet access via any of the current ASCII 
25 software mechanisms. In one embodiment, at each subscriber home, an associated 
local URI decoder 12 receives the cable video television program, as shown in Figure 
1. The local URI decoder 12 extracts the URIs, preferably embedded in the VBI of a 
video portion of the Temporal Signal, with the use of any conventional VBI decoder 
device. The URI decoder 12 may be either a stand-alone unit or a card which is 
30 implemented by the client device 16. 

In another embodiment shown in Figure 2, the URIs are encoded into the 
video portion of a Temporal Signal in the same manner as described above. Again, 
the URIs are preferably encoded onto eight fields of line 21 of the VBI, but may also 
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be sent independently of the video. In this embodiment, the URI decoder 24 is 
located at the server site, as opposed to the client location. When the decoder 24 
receives the video program signal, it strips out the URI codes on line 21 of the VBI 
and delivers these codes independently to an Internet server 28. The URI code is then 
5 subsequently delivered over the Internet 20 to the client device 16. Simultaneously, 
the Temporal Signal is broadcast over conventional broadcast or cable transmission 
means 36 to the client's device 16. 

Another embodiment of a compatible system is shown in Figure 4. This 
system does not depend on, or even use, the VBI. In this embodiment, the system 

10 provides an online service over the Internet 20. This service is in the form of an 
Internet Web site 62 that provides a client-interface to a database 78 and to one or 
more associated data servers 90. Member-accounts are provided to TV broadcasters 
66 who sign up to use the system in conjunction with their broadcasts. Each member 
broadcaster will enter the service at their computer 70 through Browser software 74 

15 using their member account by entering various identification and password 

information. Once within their account, the member will be provided with a graphical 
user interface for pre-scheduling Enhanced Content (which may include URIs) for 
transmission to clients 118 over a direct Internet connection 94 at particular times of 
the day. The same client interface, or a variation on it, can be used by broadcasters 

20 for live transmission 82 of URIs (or Enhanced Content) to clients at the same time as 
a broadcast 86. 

Other embodiments of a compatible system may be configured that do not 
depend on, or even use, the VBI, or the Internet for establishing a connection between 
the client device 16 and the location providing the Enhanced Content. For example, 

25 one such system may directly provide Enhanced Content, for example, via a wireless 
network, over a telephone network, a satellite network, or even a local area network. 
Thus, it is to be appreciated that the present invention is not limited to a system which 
utilizes a television video signal, VBIs, URIs, the Internet or any other device or 
system to provide Enhanced Content related to a Temporal Signal. Further, the 

30 present invention may be configured such that the URIs (or other triggers) are 

embedded in static media (for example, a CDROM). In such an embodiment, the 
static media, versus a propagated programming signal, pushes the triggers/URIs 
which are then utilized in accordance with the systems and processes for creating a 
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Virtual Stage and presenting Enhanced Content on a Virtual Stage, as discussed in 
greater herein. 

It is further appreciated that various embodiments can also be used which 
enable personalization in the form of unique series of Enhanced Content specific to 
each client's unique profile, which are directly sent over a network (for example, the 
Internet) to each client's device. This can be achieved from the broadcaster to each 
individual client, or to particular collections of clients. To accomplish 
personalization, the service may send a different stream of URIs or even a different 
stream of Enhanced Content to each client's device. The stream of Enhanced Content 
(or URIs identifying locations for such content) sent would depend on a client profile 
stored in the database or at the client device 16. As is well known in the art, a client 
profile may be built on demand or over time for each client based on criteria such as 
the location of the client, choices the client makes while receiving a Temporal Signal 
and/or Enhanced Content, or choices the broadcaster 66 makes during a broadcast 86, 
or automatic choices made by an algorithm (such as a filter) residing on the service 
62. Personalization enables each client to receive Enhanced Content and/or URIs 
which are uniquely relevant to their interests, demographics, history, or behavior in 
the system. 

Once the URIs have reached the client device 16, system operation is similar 
for all of the embodiments diagramed in Figures 1 , 2, and 4. In the preferred 
embodiment, a Browser 98 is installed on the client device 16. The Browser 98 
allows the client device 16 to retrieve the Web pages 102 or other Enhanced Content, 
since it is platform independent, and thus, enables efficient and flexible transfer of 
programs, images, etc., over the Internet or other networks to the client device. 
Therefore, it is to be appreciated that the process works in and/or with systems that 
push URIs to a client device and those that do not (i.e., a system wherein the first 
operation requires the client device to establish a communications link with a location 
providing Virtual Stage creation elements). In short, the system is capable of 
presenting Enhanced Content on a client device regardless of the particular systems or 
methods utilized to create a synchronization between the Enhanced Content and the 
Temporal Signal. As such, the system is independent of the communications 
medium, the format, the source, or any other element of the Enhanced Content and/or 
the Temporal Signal. However, in the preferred embodiment, the Browser is the 
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preferred platform upon which a Virtual Stage is created, as is explained in greater 
detail below. 

Further, in those embodiments in which a URI is embedded in a VBI or other 
segment of the Temporal Signal, specialized software is provided in addition to the 
5 Browser which enables the client device 16 to extract the URIs from the Temporal 
Signal. The specialized software acts as an interface between the video programming 
and the various Internet functions provided by the system. The specialized software 
retrieves URIs from the video program (embodiment of Figure 1) or directly from the 
!__=. Internet connection (embodiments of Figures 2 and 4), interprets these URIs and 

10 directs the Browser 98 to retrieve the particular relevant Web pages 102. In certain 
%j embodiments, wherein multiple URIs are sent in conjunction with the Temporal 

!£; Signal, the specialized software also synchronizes the retrieved Web pages to the 

fjj Temporal Signal for presentation to the client via the client's device 16, as shown in 

Figures 3 and 4 and explained in more detail below. 
D 15 Further, one embodiment of the specialized software also has the capability to 

jj, detect identical URIs sent directly after one another which causes the Browser not to 

fetch URIs in these particular cases. As shown in Figure 3, once the URI code is 
m received at the client device 16 (operation 38), the specialized software interprets the 

URI and determines whether the particular URI has been received previously 
20 (operation 42). If it has already been received, the next received URI is interpreted 
for determination of prior receipt. If the particular URI has not been previously 
detected, the software checks for misspellings and any other errors. If errors exist, 
the specialized software corrects the particular errors (operation 46). Once again, it is 
determined whether the URI has been previously detected. If it has, the next URI is 
25 accessed (operation 38). If the URI has not been detected, the specific URI is added 
to the URI list (operation 54). The specific URI is then sent to the Browser 98, which 
is preferably a JAVA enabled Browser. Upon receipt of the URI, the Browser 98 
accesses the Web site address 122 (Figure 4) indicated by the URI and retrieves the 
cited Web page 102 via the Internet or other network connection (operation 58). At 
30 this point, i.e., when the Browser establishes a connection with a Site providing 
Enhanced Content for a Virtual Stage, the present invention suitably establishes a 
Virtual Stage on the client device 16 utilizing the process discussed herein below. 
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Regardless of whether the URIs, addressing a Web page providing the 
Enhanced Content related to a Temporal Signal, are accessed after extraction from a 
VBI or otherwise obtained, for the preferred embodiment, the process suitably entails 
establishing a Virtual Stage on the client device's Browser before any Enhanced 
5 Content is received and presented to the client. As discussed previously, the Virtual 
Stage provides a platform (a Stage) upon which Enhanced Content may be presented 
regardless of the source of the Enhanced Content, the communications link utilized, 
the format of the Enhanced Content, the type of Temporal Signal, and the type of 
client device. 

p 10 While the Virtual Stage is discussed in the context of being created on, and/or 

J~; via a Browser, it is to be appreciated that such Virtual Stage may also be created on 

CP other platforms or applications (either generic or specialized) as desired. However, a 

~. Browser is the preferred platform upon which the Virtual Stage is built, because of the 

S widespread availability of Browsers and the non-device and/or signal specific 

l=j 15 characteristics of such Browsers. 

fU The process by which a Virtual Stage is established on the client's Browser is 

jg illustrated in Figure 8. As shown, the process begins upon the reception by the client 

Jr{ device 16 of a URI, or similar address, identifying a provider of Enhanced Content 

related to a Temporal Signal. Preferably, the extraction of the URI, as necessary, 
20 from a VBI or other segment of a Temporal Signal has already occurred and has been 
provided to the Browser for establishing a connection with the Site addressed by the 
URI (operation 802). The Browser then suitably requests a network to establish a 
communications link with an online information provider site identified by the URI or 
other address (hereinafter, the "Site"). Upon establishing a link with the Site, the 
25 Browser (either automatically or in response to a query issued by the Site) 

communicates a userid and an indication of either the URI extracted from the site, the 
Temporal Signal to which the URI relates, and/or any other incidence of Enhanced 
Content of which the client device desires to receive (hereafter, a "Skin") (Operation 
804). As such, the Skin preferably communicates sufficient information which 
30 enables the Site to determine: (1) which Enhanced Content the client desires to 
receive, and (2) the identity of the client device (and/or the client). 

It is to be appreciated, that the Browser may be configured to send the Skin 
when initially requesting the establishment of a communications link with the Site or 
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upon reception of a query from the Site. Further, a userid is preferably communicated 
by the Browser to the Site thereby providing an identification of a client to a provider 
of Enhanced Content. Such identification is desirable, for example, in an educational 
environment to identify individual students and teachers (as discussed in greater 
5 below), to facilitate user profiling and the targeting of content to such user profiles, 
and for any purposes which utilize, rely or depend upon a userid. Additionally, while 
the Skin preferably contains two elements, additional elements may also be provided, 
for example, an indication of the network or other communications system utilized to 
reach the Site, the type of client device being used by the client, the location of the 

10 client device, and/or the processing capabilities of the client device. 

At this point, a communications link is established between the client device 
and the Site (Operation 806). The communications link may be configured from any 
single or combination of system, links, devices, paths, or mediums, including, for 
example, the Internet, intranets, extranet, Ethernet, dial-up network, regional network, 

15 wireless networks, cable links, satellite links, wireless links, broadcast networks, 

hubs, routers, transmitters, and receivers. As discussed previously, the Virtual Stage 
is device, system, communications link, and content non-specific and preferably may 
be utilized on any and all devices. 

Once the communications link is established between the Site and the client 

20 device, the process of creating the Virtual Stage continues with the Site sending a java 
script program (for example, under a filename such as "stage jsp") to the client 
device. The java script preferably contains those elements necessary to initialize the 
Virtual Stage and a Stage Manager (Operation 808), which "oversees" the creation 
and use of the Virtual Stage. 

25 More specifically, upon receipt of the "stage.jsp" (hereinafter, the "Routine"), 

the client device automatically initializes the Routine. However, as desired, the 
Routine may also be configured to initialize at a later time and/or upon receipt of a 
command from the client. Once initiated, the Routine effectively detects the 
production (i.e., the presentation of the Enhanced Content related to a Temporal 

30 Signal) specific platform utilized by the client device. For example, in a first 

presentation, a Flash platform may be utilized and, in a second presentation, a textual 
platform may be utilized by the same client device. The Routine also detects those 
production specific settings (for example, the identification of the Show) and requests 
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additional pages (which may include additional program codes) from the server based 
upon the detected information. Basically, the Routine determines which 
implementation (i.e., which API) of the Show Object, Receiver Object, Subscriber 
Object, and any other Object (for example, a chat filter, and the "splash" screen 
5 presented on the client device while the Virtual Stage is configured) are needed to 
present the Enhanced Content. The Routine then requests and receives those APIs 
and other Objects and elements needed from the server (if it does not already possess 
them). 

The Show Object, Receiver Object, and Subscriber Object APIs may 
q 10 communicate with each other via structural function calls, object messages, an 

» abstract event model, or other invocation pattern, all of which are equivalent for 

rfl purposes of the present invention. Further, the Show, Receiver Object and Subscriber 

j±; Object received from the Site are, in their most basic form, expectations on the 

yQ availability of certain functions and behaviors. For each specified function/behavior, 

' n 1 5 the Virtual Stage actually implements at least one on the client device. Thus, when 

PJ the Virtual Stage is configured, at least one Show Object implementation and at least 

jf= one Receiver Object implementation (in addition to other implementations) is 

D provided. Further, each implementation of an Object (for example, a Show Objector a 

Receiver Object) is independent of the implementation of any other Object. Thus, a 
20 mix and match relationship is created by the Virtual Stage based upon the platform 
(i.e., is it an Internet Explorer Browser or a Netscape Browser), the client device (i.e., 
a personal computer versus a PDA), and the Enhanced Content presentation. Such 
mixing and matching is limited only by those implementations viable on a given 
platform, client device, and configuration of the presentation, as commonly 
25 determined by the producer of such presentation. Such a configuration is analogous 
to a video signal coming into a home via a cable box, routed through a VCR and then 
to a television. The video signal is the same regardless of the cable box receiving it. 
The cable box decodes the signal regardless of what, if any, VCR is connected to it, 
and the VCR will record and play back the signal regardless of whether a television is 
30 attached and/or turned on. Each element performs its respective job regardless of the 
precise configuration of the other element. However, the signal passing from one 
device to another ultimately must be compatible with both devices, and thus some 
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non-discriminatory dependencies exist between the devices, provided they fall within 
a given set of parameters. 

For the Virtual Stage, the Temporal Signal embeds the URI regardless of 
where they point (i.e., which data file is addressed by the URI) or how they are 
5 decoded. The Receiver Object (whether in Java, javascript, ActiveX, or another 
format) decodes the URI and calls the API of the Show Object associated with the 
type of Enhanced Content to be presented. Whichever Show Object is instantiated 
renders the URIs, including the chat, rooms, URIs, and actions, as appropriate for the 
implementation. As such, a similar set of dependencies are created between the 

10 various Objects (for example, the Show Object and the Receiver Object), while 
similar levels of non-discrimination are created between the Objects. 

Further, the "stage.jsp" program elements and the Stage Manager are saved in 
the client device or elsewhere in an appropriate storage location, for example, RAM, 
EPROM, a hard disc drive, a memory stick, or a memory card (Operation 810). At 

15 this point, or at a later point (as desired by the specific implementation of the Virtual 
Stage), the client device directs the Stage Manager to initiate the creation of the 
Virtual Stage (Operation 812). 

As mentioned previously, the Virtual Stage includes at least a Show Object 
and a Receiver Object. However, before those Objects can be created a "floor" and 

20 an organizational framework for the Virtual Stage is created. Thus, at this point of the 
initialization routine, the Stage Manager begins to create those elements necessary to 
configure the client device to operate as a Virtual Stage. As is appreciated by those 
skilled in the art, such elements are generally stored in memory locations as data 
variables and abstractions of objects commonly found in a stage. For example, a 

25 brick and mortar stage commonly contains at least one stage or presentation area on 
which the theatrical show is actually presented to the viewing audience and also 
includes hidden areas where the technical assistance necessary to "put-on" the show is 
located. Such hidden areas often include stage hands who, for example, call actors for 
appearances on the stage, and otherwise control the lighting, audio, props, the 

30 interface with the audience (when available), and various other aspects of the 
presentation. Directing the theatrical presentation is often a stage manager who 
oversees all of the functions of both the presentation itself and the stage hands. 
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For the Virtual Stage, similar elements are created, including a Show Object 
(i.e., the publicly viewable presentation platform) and a Control Area (i.e., the hidden 
areas from which the stage hands control the presentation). More specifically, the 
Control Area contains and controls those necessary interfaces between the Show 
5 Object and the external environment (i.e., everywhere except for the Show Object 
area presented on the client device). 

However, before the Virtual Stage can be created, the Stage Manager requires 
two Objects to first exist, a Queue and a Register. Both of these are preferably 
initially created by the Stage Manager (Operation 814). The Queue provides a listing 

1 0 of tasks to be completed by the Stage Manager in order to configure the client device 
for the presentation of the Enhanced Content on the Virtual Stage. The Queue is 
suitably utilized both during the configuration of the Virtual Stage and during the 
presentation of the Enhanced Content, as necessary. 

Often tasks on a queue (as used in the computer sense) are completed in the 

1 5 order in which they are entered into the queue. However, the Queue is preferably 
configured to emulate and utilize well known threading techniques from other 
programming languages including "C" and Java. Examples of such threading 
techniques include, but are not limited to, wait and notify blocking, mutex locks, 
semaphores, and synchronization. As such, the Queue preferably contains two fields: 

20 a pre-condition field (true or false), and a firing field (i.e., the particular action to be 
initiated when the pre-condition is true). 

For the Virtual Stage, the Queue preferably utilizes at least one threading 
technique to determine when to cycle through its listing and trigger applicable events, 
tasks, and/or Objects. As is commonly appreciated, the wait and notify technique is 

25 more efficient than using a polling technique, as such the Virtual Stage preferably 
utilizes a wait and notify scheme. However, utilizing this and similar techniques 
creates a dependency for the Queue upon other Objects (for example, the Register) to 
notify the Queue of state changes and, thus, for specific applications, other threading 
techniques may be utilized. 

30 The other element the Stage Manager initially creates is the Register. The 

Register is basically a table identifying the existence of an element and how it can be 
reached. In the brick and mortar stage, a register might include a listing of stage 
locations (which may be hidden or in view) and how to get to such locations (for 
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example, a stage location situated on a raised lighting assembly might include 
directions on how to find the assembly). In the Virtual Stage, the Register preferably 
contains two columns, an Object column and a Key column. The Object column 
identifies a particular Object and the Key column identifies where the particular 
5 Object is located (for example, a RAM pointer or java script pointer which identifies 
where the Object can be found in a memory or storage device). The Register enables 
the various Objects of the Virtual Stage to create dependencies to each other, such 
that when a first Object is referenced by a second Object, they may suitably locate 
each other. 

10 Additionally, the Queue and the Register preferably work in conjunction to 

initialize the Virtual Stage. For example, when an Object is added to the Register, the 
Register suitably "announces" the Object and thereby signals the Queue to survey 
those tasks on its listing and perform any task which was waiting, for example, upon 
the "announcement" of the given Object. 

15 At this point in the Routine, the Register preferably contains only one row 

containing a reference to the Stage Manager itself and where the Stage Manager is 
located. 

Once the Queue and the Register have been created, the initialization process, 
which is suitably customized on a per-production basis continues with the Stage 

20 Manager calling a push method from the initialization routine stored in the memory 
location identified in the Register as the location of the Stage Manager. Or, in other 
words, the Stage Manager instructs itself to perform a specific task (a push method) 
which is co-located with itself. The push routine directs the Stage Manager to create a 
framework for the stage and the hidden Control Area off the stage. Additionally, the 

25 push routine loads into the Queue an instantiation (a time specific representation) of a 
Show, a Receiver Object and, optionally, a Subscriber. As other elements are needed 
for a specific Virtual Stage implementation, such elements may also be pushed into 
the Queue at this time or a later time. 

In the Virtual Stage, the Show Object provides instructions to the client device 

30 on how to utilize its presentation space (i.e., the stage platform) to present the 

Enhanced Content. To provide such instructions, as mentioned previously, the Show 
Object is preferably configured as an API which knows how to present to the client, 
via the Browser, pushes, chats, and rooms. However, before such elements may be 
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presented on the Show Object to the client, the Stage Manager must first subdivide 
the stage platform into an appropriate number and configuration of sectors, or frames, 
as needed (if any). 

In a brick and mortar stage, for example, risers are situated in various portions 
5 and locations, such as "stage left" or "stage right" to divide the main stage into 

segments. Additionally, the brick and mortar stage might also contain initially only 
one frame (i.e., a stage with no risers, props and/or furniture), upon which additional 
elements are added or subtracted as needed. Additionally, it is appreciated in such an 
environment, that sub-frames are dependent upon the main frames upon which they 
10 are built. For example, a riser can not be extended until the main stage exists. 

Similarly, for the Virtual Stage, a sub-frame can not exist until the frames 
upon which it depends exist. As such, a hierarchical relationship exists between the 
various frames and sub-frames which may exist for a Show. Often such a relationship 
is a cascading relationship. For example, suppose a frame definition for Virtual Stage 

15 existed as follows: 

element "A" is identified as "A.html" and is situated in the top (the root) of the 

tree and is always available; 

element "B" is identified as "B.html" and located in section "X" of element 

"A"; 

20 element "C" is identified as "C.html" and located in section "Y" of element 

"A"; and 

element "D" is identified as "D.html" and located in section "Z" of element 
"C". When a push targeted at section "W" of element "D" arrives, the following 
cascade of pushes occurs: 
25 "D" is not available yet, so "D.html" is pushed into "Z" of element "C"; 

since "C" is not yet available, "C.html" is pushed in to "Y" of element "A"; 

since "A" is not yet available, "A.html" is pushed into top. 

The result being that none of the pushes occur because none of their respective 
pre-conditions have been satisfied. However, when "A.html" completes, it announces 
30 itself to the Queue, firing the push of "C.html". When "C.html" completes, it 

announces itself to the Queue firing the push of "D.html". When "D.html" completes, 
it announces itself to the Queue firing the push of "W" into "D" - the original request, 
which is then completed. All of these actions commonly occur in a client 

-22- 



Express Mail Label No.: EV 016 648 668 US 
Attorney Docket Number: 10016.02 

imperceptible moment. Thus, dependencies and cross-dependencies may exist 
between the various Objects which constitute the Virtual Stage. 

Additionally, utilizing this configuration, the system correctly handles 
competition for the same resources (or stage locations) by utilizing a last in time, last 
5 in right system, wherein the last Object to announce itself, unannounces any other 
Object competing for the same resources. In this manner, the Virtual Stage does not 
have to concern itself with deleting unneeded Objects or elements as their existence is 
unannounced once a competing Object or element acquires a given resource. 
However, in alternative embodiments, an "unannounced" system or approach may 
D 10 also be utilized. 

rj The Virtual Stage also enables the framing to be defined initially and then may 

tfl vary as the presentation proceeds. To accomplish such framing, the client device 

ffi preferably divides its presentation space (e.g., the video screen's area) into a given 

^ number of frames and sub-frames. When an HTML platform is to be utilized, the 

D 15 client device may, for example, create three frames, one frame in which chat 

1^ messages occur, a frame in which advertisements are presented, and a frame in which 

,p on-line content is presented. Similarly, when a FLASH platform is to be utilized, the 

client device may create only one frame on which the FLASH segments are suitably 
overlaid. The number of frames may increase or decrease. For example, a client may 
20 decide that they do not wish to receive chat content. In such an event, the Stage 

Manager may suitably reconfigure the frames, or may leave the chat frame ("room") 
open for the client to later re-enter. 

For the preferred embodiment, a single frame stage is preferably utilized and 
upon which FLASH presentations are suitably overlaid, as discussed in the FLASH 
25 application. An instantiation of such a Show Object on a single main frame stage 
might include a push as follows: "stage/show/flash/ie.main". This push directs the 
client device to establish on an Internet Explorer (IE) configured Browser a stage 
which includes a main frame on which a Show Object composed of Flash elements is 
to be presented. Other instantiations of a Show Object frame push might include, for 
30 example, "stage/show/html/ie.main", in which Hyper Text Markup Language 

(HTML) based Enhanced Content is presented on the main portion an IE Browser. 

Similarly, instantiations of a Show Object may be utilized for other Enhanced 
Content formats including: FLASH content ("stage/show/flash/ie.main"), XML 
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content ("stage/show/xml/ie.main''), DHTML, Java and other formats, and/or for 
other types of Browsers (such as a Netscape® Browser or AOL® Browser) or client 
devices. It is to be appreciated that as the presentation area of a client device is 
dissected, additional instantiations of a Show Object sub-element may also be 
5 provided to the Queue. 

Regardless of the number of frames and sub-frames created on the Virtual 
Stage by the Stage Manager at initialization or later in the presentation, once a frame 
is created, each frame ultimately is matched with a Show Object element, an 
instantiation of which is suitably listed in the Queue. The Show Object element is 
10 that element which identifies to a Receiver Object where it is located and how 

Enhanced Content is to be presented. A Show Object element may be configured for 
processing content, chats, and/or other types of Enhanced Content. 

Further, as mentioned previously, after the announcement of an Object, the 
Queue suitably cycles through its listing searching for any Objects (actions, or other 
15 elements) to trigger, which depend upon the given announcement. For example, a 
Show Object action may require a sub-frame off a main frame to be provided on the 
Register and announced before the Show Object element on the Queue is triggered. 
That is, the sub-frame can not exist on the Register until the main frame exists. 
Likewise, the Show Object can not exist until both the main frame and the sub-frame 
20 exist on the Register. Thus, as the Queue completes its various configurations of 
Objects, such Objects are suitably identified in the Register. 

Once a first Object is identified in the Register, any other Object requesting or 
depending upon the first Object may obtain a reference location from the Register 
(until the Object is unannounced). In short, the Register provides pointers to where 
25 other Objects are located such that mutual dependencies between Objects may be 

created, as dictated by the Stage Manager. Since mutual dependencies are created, as 
necessary, between various Objects utilized by the Virtual Stage, a single Object does 
not depend upon how a specific Object is implemented and instead merely depends 
upon the Object's functionality (for example, retrieving Enhanced Content from a site 
30 regardless of how accomplished). 

For a brick and mortar stage, similar dependencies often exist. For example, 
an actor in a play depends upon a lighting technician (commonly located in a back- 
stage, hidden area) to control the lighting of the stage to enhance the mood and 
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environment in which the actor is trying to present. The actor generally is not 
concerned with how such lighting is generated and instead merely depends upon the 
lighting to accomplish the scene. However, when the function (the lighting) ceases to 
operate, for whatever reason, the actor can no longer perform the scene. Thus, 
5 dependencies exist between the actor and the stage hand that are based upon the 

functions performed by each and not on the specific details of how such functions are 
provided or implemented. 

In addition to pushing the Show Object (i.e., how the presentation area of the 
client device is to be utilized), the Stage Manager also pushes a Receiver Object and 
10 (optionally) a Subscriber Object to the Queue. The Receiver Object and the 

Subscriber Object are similar to the lighting technician (stage hand) of the brick and 
mortar stage in that they provide hidden functions which are often crucial to the 
success of the presentation by the Show. Both the Receiver Object and the Subscriber 
Object are provided for in a hidden Control frame (i.e., a "backstage" area of the 
15 Virtual Stage that is not presented to the client) (Operation 818). As with the Show, 
which requires a frame to be constructed before the Show Object itself could be 
constructed, the Receiver Object and/or the Subscriber Object also require a Control 
Area to be Registered before they can be configured and instantiated by the Stage 
Manager into abstractions identified by the Register. Further, the Control area itself is 
20 preferably identified as a hidden frame on the Browser that is further broken into two 
hidden sub-frames, a receiver and a subscriber. The process of creating the Control 
Area mirrors that of creating the main frame and other sub-frames. However, unlike 
the main frame and its sub-frames, the Control Area is preferably never modified or 
deleted during a presentation as its existence is crucial to the success of the show, 
25 even though it is hidden. Deleting the Control Area is comparable to pulling the 

power on a brick and mortar theatrical presentation, in that the presentation (i.e., the 
show) would immediately grind to a halt. 

Similarly, just as a brick and mortar show may be restarted after a power or 
other interruption, the Virtual Stage may also be restarted or continued (when non- 
30 volatile memory is utilized to contain the various Objects utilized by the Virtual 

Stage). More specifically, since the Stage Manager itself is identified in the Register, 
the Show Object may be restarted by the Stage Manager re-configuring and re- 
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instantiating the Control Area, the Receiver Object, the Show Object, and the 
Subscriber, and other elements, as necessary, in the Queue and the Register. 

Once the Control Area is appropriately configured, the process of creating a 
Virtual Stage preferably continues with creating the Receiver Object. The Receiver 
5 Object is preferably the Object which creates and maintains a down channel with the 
Site (which may or may not be a Virtual Site). More specifically, the Receiver Object 
identifies itself as being that Object which will handle pushes, chats, rooms, and 
subscription announcements sent by the Site to the client device. Pushes, chats and 
, a rooms are herein described in abstract terms. The Receiver Object is preferably 

D 10 configurable such that it may receive pushes, chat, etc. regardless of their format (i.e., 

5 TCP/IP, UDP, etc.). For example, "hypervbi.html" might be one instantiation of a 

Receiver Object which knows how to receive Enhanced Content provided in a VBI. 
m Similarly, "hyperweb.html" might be an instantiation of a Receiver Object which 

^ knows how to receive Enhanced Content provided over a Web connection. Based 

O 15 upon the configuration of the client device and/or the configuration of the Site (or the 

J y Virtual Site), the Stage Manager appropriately configures a Receiver Object that is 

5 

dp compatible with the Site. As mentioned previously, the configuration of the Receiver 

~ J Object, the Subscriber, and other elements is determined at the time of initializing the 

Routine. 

20 The Receiver Object also identifies itself as being the Object which will call 

those routines provided in the Stage Manager and the Enhanced Content provided by 
the server to configure the client device to receive pushes. These pushes may be 
provided via various communications links and in various formats including, for 
example, over an Internet connection, a television broadcast connection, or a wireless 

25 connection. In this regard, the Receiver Object mirrors the Show Object in that the 
Receiver Object knows how to receive the pushes which are then rendered and 
presented to the client by the know-how of the Show. Since the Receiver Object and 
the Show Object are abstractions and APIs (as discussed previously), it is to be 
appreciated that they may be implemented on any device, utilizing any configuration. 

30 Thus, it is to be appreciated that the configuration of the Receiver Object vis-a-vis the 
Site, may occur at the Receiver Object, the Site and/or somewhere in-between (for 
example, a network hub). 
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The Subscriber Object is the other Object utilized to control the basic 
operation of the Virtual Stage. The Subscriber Object basically is an abstraction of a 
device which knows how to send chats and subscribes from the client device to the 
Site. As provided for the Receiver Object and the Show, the Subscriber Object is also 
identified in the Register to enable the Show Object to know where the element 
capable of sending subscribes and chats is located. The Subscriber Object also 
accesses those elements provided in the Stage Manager and/or the client device to 
make possible such chats and subscribes. 

Up to this point, the Stage Manager has merely told the client device how to 
present information received from the Receiver Object, how to establish a connection 
with the provider of the Enhanced Content to be presented to the client via the Show, 
and how to subscribe to chat rooms and send, receive and present chat messages. 
However, while the preferred method includes an abstraction of only a Show, a 
Receiver Object and a Subscriber, it is to be appreciated that various other 
abstractions of Objects may be specified by the Routine and implemented by the 
Stage Manager. For example, an alternative embodiment of a Stage Manager may 
abstract two Receiver Objects, one for receiving Internet based content and one for 
receiving wireless content, both of which might be suitably presented on a single 
Show. Regardless of the number and/or type of abstracted Objects utilized, the 
present invention is preferably configured with, as a minimum, a Show Object and a 
Receiver Object. Further, the foregoing actions occur in today's processors so fast, 
that a client device is generally configured and ready to receive Enhanced Content 
without incurring any human perceptible delay. 

Once the Show Object and the Receiver Object have been configured and 
identified in the Register (i.e., announced to the Stage Manager ;and the Queue), the 
process continues with the Stage Manager communicating a Stage (which includes an 
identification of the Receiver Object and the Show) to the Site (Operation 820). The 
Stage contains an identification that the Virtual Stage that is ready to receive the 
Enhanced Content. In the brick and mortar example, the communication of the 
existence of the Virtual Stage corresponds to a curtain call, wherein the actors and 
others (i.e., the Site) are informed that it is show time. Shortly thereafter, the various 
elements of the show (i.e., the Enhanced Content) are then presented to the viewing 
audience (i.e., the client). Importantly, the Stage and the Receiver Object are 
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basically oblivious to the source of the Enhanced Content as they are mere 
abstractions, which are capable of receiving the Enhanced Content. 

As such, the preferred embodiment of the process enables one to provide code 
for configuring the client device at either the server Site or the client device. The 
5 present invention facilitates the removal, to the server, of many of the device 
configuration actions thereby reducing the amount of memory, downloads, and 
routines needed to be used and/or executed by the client device to configure a Virtual 
Stage. However, it is to be appreciated that placing the device configuration codes on 
the Site results in less scalability, whereas placing the device configuration codes on 
h 10 the client device increases memory utilization. Thus, a trade-off exists between the 

H higher scalability and the amount of memory needed on a client device to provide a 

0l given level of scalability. 

JL: Once the Stage is announced to the Site, the Site may then commence sending 

*S the desired Enhanced Content. However, often many Sites require a client to 

L 15 subscribe to the Site. The Subscriber object handles requests for subscriptions, which 

fll are suitably received by the Receiver Object, passed to the Show Object for 

5 presentation to the client, and then to the Subscriber Object (which may automatically 

D generate or be manually configured to generate the subscription) and then send the 

subscription to the Site (Steps 822 and 824). 
20 At this point, the client device is configured and ready to receive Enhanced 

Content that may or may not relate to a specific Temporal Signal. The Receiver 
Object receives the Enhanced Content pushes and provides such pushes to the Show 
Object for presentation to the client via, for example, a Browser. These pushes may 
come in any format including, but not limited to, URIs, content pushes, frame set 
25 pushes (which reconfigure the framework for the presentation area of the Browser), 
functional pushes (which often include both commands and data), and RAID pushes 
(as discussed in the above referenced FLASH application). Since these various types 
of pushes provide varying levels of commands and content, the Stage Manager is 
preferably configured to process functional pushes and RAID pushes, while the Show 
30 Object handles frame pushes and content pushes. Further, such pushes are carefully 
and precisely determined when pertaining to the hidden control area, the Receiver 
Object and/or the Subscribe Object, as a mis-configuration of such Objects/pushes 
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may wreck havoc with the client devices' ability to receive and process Enhanced 
Content. 

Thus, the Virtual Stage is preferably implemented on a Browser and is not 
implemented as a stand-alone application. However, the Virtual Stage may be 
5 implemented as a stand-alone application, as desired, with appropriate trade-offs in 
the necessary java script or Java applet or similar files to be downloaded and stored 
on the client device. In another embodiment, the Virtual Stage suitably reduces the 
need for large downloads and time consuming initialization routines and thereby 
enables the Enhanced Content to be quickly presented to a client via virtually any 
10 compatible device by providing such capabilities at the Site (or the Virtual Site). 

Further, since the client device utilizes an abstraction of a Receiver Object in 
order to establish a communications link with a Site and receive Enhanced Content, it 
is to be appreciated that such abstractions may also occur at the Site itself. For 
example, a Site may be abstracted such that a single playlist for an Enhanced Content 
15 presentation may be generated, which is then abstracted by the Site, as necessary, into 
the appropriate data formats requested by the Receiver Object. Thus, a producer of 
Enhanced Content is capable of producing a single rendering of a playlist which may 
be communicated to various client devices over various implementations of a Site 
including, for example, an Internet site, a wireless site, an intranet site, and a 
20 broadcast site. 

Additionally, it is anticipated, for example, that a television game show 
program presenting Enhanced Content to a multitude of clients may frequently 
encounter sudden bursts of responses (subscribes or chats) from multitudes of clients 
attempting to answer a game show question. Current server systems are extremely 
25 inefficient and often incapable of processing such sudden and dramatic subscribes 

because they often are configured to process a transaction completely before returning 
to a given process and then format the return values with the result. In contrast, a Site 
implementing the present invention preferably utilizes a Capture module, which is 
preferably located at the Site (or an independent location designated for receiving 
30 client subscribes). The Capture module provides an upstream data capture module 
which does not provide an immediate return value. Instead, the Capture module 
returns to the client before a transaction is completed. The Capture module schedules 
each client's subscribe/response for processing. Thus, the Capture module enables a 
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Client to send up various pieces of information without delay. Further, the upstream 
interaction occurs on a queue hidden frame such that multiple upstream requests can 
be pending at any time and from multiple clients. This configuration allows the Show 
Object to continue processing Enhanced Content segments even if the upstream 

5 channel is blocked or unavailable for an extended period of time. 

An exemplary implementation of the Virtual Stage can best be understood 
with reference to an example. A client can begin watching a musical video featuring 
a new band. As the video is received by the client device 16, URIs are either being 
received with the video signal or are being received directly via the Internet 20 or 

10 another data channel, and are being interpreted by the specialized software 106. Upon 
the first instance of receiving an indication that Enhanced Content is available, the 
Browser 98 retrieves a particular Web page 102 from an Internet 20 Web site that is 
identified manually or automatically. Upon establishing a connection with the Web 
site, the Browser receives the "stage.jsp" program and begins installing the Virtual 

15 Stage. 

Once the Virtual Stage has been established and its existence notified to a Site 
providing the Enhanced Content, the client device 16 may then begin receiving 
Enhanced Content, regardless of the source of such content. In a frame based 
example, such Enhanced Content is provided via HTML based Web pages which are 

20 suitably displayed on the video screen in a pre-determined frame format, at particular 
times. In the preferred Flash implementation, the Enhanced Content is presented as 
overlays to a master movie. Thus, for example, while the viewer is watching the 
music video, biographical information on the band can also be displayed adjacent to 
the video window, or in Flash, as an overlay on a full frame or partial frame window. 

25 The Enhanced Content could also include an upcoming concert schedule, or even 
audio clips of the band's music may be downloaded from the Internet. 

As another example, a client could be watching a program relating to financial 
news. While the narrator is shown discussing high tech stocks, Enhanced Content 
corresponding to detailed financial performance information on high tech stocks, 

30 environment and characteristics can be displayed with the video on the Virtual Stage. 
Such Enhanced Content can be presented regardless of the source of the information 
or the type of device utilized by the client. However, preferably a Browser or 
application program is utilized on the client device to control the presentation space. 
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If the personalization features are included, Enhanced Content associated with a 
particular client's stock can be fetched and displayed on the Virtual Stage with the 
Temporal Signal. When the narrator in the Temporal Signal switches to a discussion 
on the weekly performance of the Dow Jones, Enhanced Content presenting related 
5 financial performance information can be simultaneously displayed. Thus, it is 
evident that the present invention profoundly enriches the viewing and/or learning 
experience and the ease of providing and configuring such an experience. 

It is understood that there can exist alternative embodiments for use with the 
present invention. For example, the client can view the Temporal Signal using a 
io television set or other display monitor in conjunction with the display screen of a 

p 

0 client device (for example, a personal computer) presenting the Virtual Stage. In this 
embodiment, the relevant Enhanced Content is shown on the client device while the 

01 Temporal Signal is displayed on the television monitor. In this alternative 

~S embodiment, a cable set top box receives the Temporal Signal, for example, a 

* 15 television program, from the multi-channel cable. The client device also receives the 

St Temporal Signal from the multi-channel cable and extracts the URIs, embedded in the 

M VBI of the video signal or directly transmitted over the Internet. The specialized 

q software, as needed, extracts the URIs and retrieves the particular Enhanced Content 

ry as described above. The Virtual Stage is then created on the client device and the 

20 Enhanced Content related to the Temporal Signal is presented to the client. It is 

understood that a hyperlink may exist on the Site that will allow the client device to 
automatically load the specialized software needed to extract URIs from a Temporal 
Signal, the Virtual Stage and call up the specific television channel referenced in a 
Site and providing Enhanced Content related to a Temporal Signal. 
25 For example, someone browsing the Internet may come upon a major 

television network's Web site. They scroll to an interesting story then click on a 
hyperlink, which provides the software necessary to create a Virtual Stage on their 
device (if one has already not been created). The Virtual Stage suitably includes a 
television frame in which the Temporal Signal is presented and another frame (or an 
30 Overlay in the Flash environment) in which the Enhanced Content related to the 

Temporal Signal (or even to a second, non-displayed, Temporal Signal) is displayed. 
For example, a signal providing a first baseball game's box score may suitably 
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overlay a signal providing the video portion of a second baseball game in the 
television frame. 

Furthermore, instead of receiving Temporal Signals from a transmission 
means, the Temporal Signals can also be addressed directly from the client site if the 
5 Temporal Signal, with or without embedded URIs, is stored on a VHS, Beta, DVD, 
CD, memory stick or other storage medium. In this embodiment, the client device 
and/or television are connected to a VCR, DVD, CD player or other appropriate 
device. 

Figures 5 and 6 show two alternative embodiments for use with the present 
10 invention. For example, the client can view the interactive program using a television 
set 18 or other display monitor in conjunction with a digital cable box 140, as shown 
in Figure 5. In this embodiment, the digital cable box 140 performs the functions of 
the client device 16 shown in Figures 1, 2 and 4. In the embodiment shown in Figure 
5, the specialized software is stored in memory in the digital cable box 140. In one 
15 embodiment, the digital cable box 140 includes two tuners, thus allowing both the 
Enhanced Content, preferably using the Browser, and the Temporal Signal (for 
example, a video program) to be simultaneously viewed on the same screen. The 
screen may be configured as one Virtual Stage, or even split in two, wherein a first 
portion of the screen is configured as a television monitor and a second portion of the 
20 screen is configured as the Virtual Stage. If the Temporal Signal and Enhanced 

Content, however, are carried on one channel, then only one tuner may be necessary. 

The specialized software retrieves URIs from the received video program, 
directly from the Internet connection 20 or via a separate data channel, interprets these 
URIs and directs the Browser to access the particular relevant Site at which the java 
25 script code script elements needed to establish the Virtual Stage are provided. Once 
the Virtual Stage is established, the digital cable box receives the Enhanced Content 
that is synchronized to the Temporal Signal for presentation to the client via the 
television 18, as shown in Figure 5. In this embodiment, the relevant Enhanced 
Content is preferably shown in one frame of the television 18 while the video 
30 elements of the Temporal Signal are displayed in another frame. Alternatively, the 
Enhanced Content can replace the Temporal Signal on the display, as desired. 

Further, in this alternative embodiment, the digital cable set top box 140 
receives the television program from the multi-channel cable. The URIs identifying 
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the location at which the Virtual Stage and/or the Enhanced Content are located is 
preferably encoded into the digital program channel using MPEG 1, MPEG 2, MPEG 
4, MPEG 7 or any other video compression scheme. Alternatively, the URIs can be 
transmitted to the digital cable boxes 140 from an Internet server 148. The digital 
cable box 140 decodes the URIs from the digital video signal or directly transmitted 
over the Internet 20. The specialized software decodes the URIs and retrieves the 
particular Virtual Stage information and/or Enhanced Content as described above. 
The Enhanced Content is then preferably synchronized with the particular Temporal 
Signal and presented to the client on the Virtual Stage. 

As with all the embodiments described above, instead of receiving the 
Temporal Signal from a transmission means, the Temporal Signal can also be 
obtained directly from a local source 144 if the Temporal Signal, with or without 
embedded URIs, is stored on a VHS, Beta, DVD, CD, or memory stick, or other 
recording/storage medium. In this embodiment, the digital cable box 140 is 
connected to a device capable of communicating the Temporal Signal from a 
recording/storage medium to a client device, in, for example, the digital cable box 
140. System operation then continues, as above, with the Browser contacting the Site, 
establishing the Virtual Stage and receiving the Enhanced Content related to the 
Temporal Signal. 

Figure 6 discloses an embodiment wherein a digital TV 152 is the remote 
reception unit. In this embodiment, the digital TV 152 performs the functions of the 
client device, shown in Figures 1, 2 and 4, and the digital cable box 140 shown in 
Figure 5. In the embodiment shown in Figure 6, a processor and memory are 
incorporated into the digital TV 152. Further, the specialized software and a Browser 
are implemented into memory in the digital TV 152. All of the functions described 
above with reference to the other embodiments are performed in a similar manner by 
the digital TV 152 embodiment. 

Although the digital cable box/TV 140, 18 and digital TV 152, shown in 
Figures 5 and 6, are incorporated into the embodiment of Figure 1, they also could be 
substituted for the client device 16 shown in Figures 2 and 4. 

For example, when the Temporal Signal includes a video portion, the client 
can view the video and the Enhanced Content on one screen (in two windows), in 
whole or in part, via the Virtual Stage. Similarly, the Temporal Signal can be viewed 
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on one display screen and the Enhanced Content on a separate display monitor. 
Alternatively, the client can access the video or Enhanced Content separately. Thus, 
the client can branch from video to Enhanced Content and vice versa. 

The present invention is well-suited to the education environment. In this 
embodiment, students and teachers access one or more Web servers. The software 
components include instructor and student user software, authoring software and 
database assessment software. In one such embodiment, an instructor uses content 
creation software on a suitable device, for example, a personal computer, to easily 
integrate into their curriculum current information published on the Web, through an 
easy to use interface, such as one provided on a Virtual Stage (which in this 
embodiment is recognized as a "Virtual Classroom"). The instructor creates a lesson 
(i.e., a Show), the lesson comprising a listing of Web pages, text notes and questions. 
Further, the Web sites and questions are set forth in a predetermined order and can be 
assigned times. Preferably, the URIs identifying the Web site and time stamps are 
sent automatically to the desktop of each student assigned to the Virtual Classroom, 
either during playback of a pre-recorded program or during a live event. 

In the educational embodiment, the Virtual Classroom provides a classroom 
(much like a real classroom) at which a lesson (the Show) may be presented. 
Preferably the Virtual Classroom is analogous to an actual classroom in that students 
may view the classroom (i.e., the Virtual Classroom) regardless of their perspective 
(i.e., their client device), the time of day, and/or their location. Further, via a Virtual 
Classroom, the students may interact with the instructor (the Stage Manager) of the 
lesson. For example, via a chat interface, video images of themselves posing a 
question to the class may be presented to the Virtual Classroom for all participants to 
view. As discussed previously, the lesson (i.e., the Show) provides an API through 
which the instructor may push content, provide and/or allow chats, and establish 
various rooms in which students may be presented with the assignments, experiments, 
and various educational materials and/or activities. Since the lesson may be pre- 
recorded and/or live, each student, via their client device, may be part of the Virtual 
Classroom from a remote location and regardless of the type of device utilized by the 
student, provided certain minimum requirements are met. 

At each of the student devices, the educational program presented on the 
Virtual Classroom as a lesson is produced/directed by the instructor via pushes from a 
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Site (i.e., a teacher) to the Stage Manager, via the Receiver Object. In other words, 
the Site (i.e., the teacher) provides the structure for the educational experience. At 
predetermined times as dictated by the Site, the Browser fetches and displays 
Enhanced Content segments on the Virtual Classroom. Such segments may be 
5 obtained from the Site or an alternative site, as directed by the instructor. Because the 
lesson can be set up in this manner at predetermined times, the entire lesson can be 
prerecorded and stored in a Web database for later access by the students. For 
example, a student having difficulty completing a homework assignment could access 
the lesson from home and re-learn those elements they missed in class (virtual or 
U 10 rea1 )- 

=f A significant advantage of an embodiment for educational applications is that 

<y the students and the instructor can be located anywhere, as long as they can be all 

iL: connected to the lesson via a Virtual Classroom. Similarly, a virtual tutoring 

CO environment may also be created. Further, because a teacher is essentially controlling 

15 the educational experience, the lesson can take almost any desired form on the Virtual 
G Classroom as presented on the student devices. 

jj Unlike conventional distance learning systems, systems consistent with the 

HF present invention are more powerful by allowing the instructor to freely and 

=j conveniently exercise almost any type of testing strategy without concern as to the 

20 type of devices and/or location of students to the lesson. As such, students connected 
via wireless devices, computer workstations, or other devices may be suitably 
connected to the Virtual Classroom. The instructor can test students using a 
combination of the chat dialogue feature and Enhanced Content. For example, 
multiple choice questions and short answer questions can appear in the chat section. 
25 Essay questions, requiring longer answers, become Enhanced Content frames. As 
mentioned above, students can perform virtual experiments on-line. Once the 
instructor's device (for example, a personal computer) receives student answers, 
student scoring can be presented to the instructor in any format including tables, 
charts, diagrams, bar graphs, etc. The instructor, thus, can analyze the results and has 
30 the capability of providing real-time feedback to the students. 

Students can also receive individualized feedback via branched interactive 
audio, video and/or graphics responses. For example, a student device may branch to 
a particular audio response contained in a segment of Enhanced Content, preferably 
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prerecorded in the instructor's own voice, based on the student response to a multiple 
choice question. In this embodiment, a plurality of potential audio responses are 
made available at the student's device according to any one of the methodologies set 
forth in, for example, U.S. Patent No. 5,537,141, entitled DISTANCE LEARNING 
5 SYSTEM, which is herein incorporated by reference in its entirety. Alternatively, 
personalized video, audio and graphics segments can be delivered and displayed to 
the student based on a student answer or personal profile in the manner set forth in 
U.S. Patent No. 5,724,091, entitled COMPRESSED DIGITAL DATA 
INTERACTIVE PROGRAM SYSTEM, which is herein incorporated by reference in 
10 its entirety. 

In another embodiment of the present invention, a system is described that is 
capable of handling the education requirements of several schools utilizing multiple 
Virtual Classrooms in an efficiently designed network. The system shown in Figure 7 
solves the problems inherent in attempting to service large numbers of users, the most 

15 obvious obstacles being the issues of load, performance, and varying types of student 
devices. In this embodiment shown in Figure 7, communications servers 180 
distribute and route messages across a LAN, WAN and the Internet. Referring to 
Figure 7, in the center of the diagram is the Group Database server. Surrounding the 
database server are several Com Servers 180, each serving an area 192. Surrounding 

20 each Com Server 180 are squares representing student devices 188, which are suitably 
configured with a Virtual Classroom permitting various types of devices to 
communicate to a Com Server 180, regardless of the communications path(s) utilized. 
The Communication Servers 180 are organized in node relationships with one 
another. 

25 Each node is responsible for serving an Area 192. An Area 192 is defined as a 

virtual location serviced by a single Communications Server 180 (or "Com Server"). 
An Area 192 may be a single school, an office, or may consist of several actual 
physical or virtual locations. The defining characteristic of an Area 192 is that 
messages sent from one member of an Area 192 to another need not be routed outside 

30 of the servicing Com Server 180. An Area member is analogous to the frequently 
used term "student" (or "client"). 

The Distributed Communication System of Figure 7 permits the dynamic 
addition of Communication Servers 180 within a group with little or no administrative 
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tasks as well as the addition of groups within an overall communications network. A 
Communication Server group consists of several defined virtual Areas 192 
(preferably, consisting of no more the 250 client devices each), each Area 192 
serviced by a single Com Server 180. This system enables client devices of one Area 
5 192, or group to easily communicate with client devices in another Area 192 or group 
without any configuration changes by using Virtual Classrooms on each student 
device that are system and configuration independent. As such, a student in one Area 
192 (for example, the United States and using a CMDA equipped wireless phone) 
need not be concerned that their messages are compatible with another student in 
H= 10 another Area 192 (for example, a student in Europe using a GSM equipped wireless 

r) phone) because the Virtual Classroom on each student's device enables the client to 

2f receive messages without regard to the format, provided a communications path 

y = 

g% between the two can be established which provides a translation service from one 

communications signal format to another. 
« 15 Further, service of very large numbers of students has required large expensive 

5fj servers and networks. As the user base increases, performance suffers and hardware 

H : must be upgraded to service the demand. 

S The Distributed Communication System of the present invention allows the 

FU same, relatively inexpensive machines to serve an ever-increasing user base because 

20 each student device (preferably configured with a Browser) may utilize a Virtual 

Classroom that is platform and communications path independent. The technique by 
which this will be accomplished will be through the routing of messages from one 
server to another when necessary until it reaches a student device with a Browser and 
a Virtual Classroom. 

25 The method essentially follows the same core pattern as IP routing and DNS 

lookups. If a message is for a member not belonging to the current Area 192 or 
group, the message may be routed through the Distributed Communication System 
until its destination, or someone who knows the destination and can deliver the 
message, is found. The destination may be cached so subsequent messages for that 

30 student or group of students may be more efficiently delivered, and/or until a Virtual 
Classroom is established on the specific student's device. 

Referring again to Figure 7, if a message is posted by student "A" and is 
intended only for the students of group 1 the message preferably never leaves the 
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Area 1 Com Server. However, if the message is intended for students of Area 1 and 
Area 2, the Area 1 Com server forwards the message to the group database server 
184. The message may be broadcast to the students of Area 1 and tagged in the 
database 184 as belonging to Area 2. The message may then be routed to Area 2 and 
5 broadcast to Area 2 students. With this technique any student can potentially send a 
message to any other student via the Virtual Classroom or even during a Virtual Chat 
session'(i.e., a session in which a Virtual Stage or Virtual Classroom is primarily 
configured as a chat room or a similar room for providing video and/or audio 
communications and interactions between one or more clients). If the Area Com 

10 server 180 does not recognize the destination, the message is forwarded up the line. 
Each Com server 180 does not need to know about any other server 180. Messages 
are routed until they are delivered. If undeliverable, the original sender is notified. 
Since each Com server 180 may also be equipped with a Virtual Classroom, the need 
for Com servers 180 to share a mutual operating platform may be significantly 

15 reduced. 

New Areas 192 can be added on the fly. When a new Com server 188 is added 
to the network, it registers itself with the database application, establishes Virtual 
Classrooms on its associated student devices, and provides an indication of the type of 
signals and devices it prefers to receive. Henceforth, any message destined for the 

20 new Area 192 can be routed properly without altering the other Area Servers 180. 
This method and system works for global messages or for student to student 
messages. Furthermore, new Groups may also be dynamically added. Once added, 
each new Group Database Server 184 registers itself with the existing database 
servers 184. This distribution of load permits nearly unlimited expansion with existing 

25 software and hardware. Each server manages a finite number of students, 
cumulatively serving a growing community, for example, a large university. 

Students need not be informed as to the particular Com Server 180 they should 
connect to. Students are directed to a single URI at which those routines necessary to 
establish the Virtual Stage/Classroom/Chat room is provided. The selection of the 

30 server for user connection is determined by load balancing software. In this manner, 
the network may appear to be a global network of Servers or simply a local 
classroom. 
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The unique aspects of this architecture, using database servers as routing 
gateways, using techniques resembling IP routing and DNS lookup, and utilizing 
Virtual Classrooms, where appropriate, to increase interoperability of systems and 
devices enables this system to serve with minimum administration and configuration 
and with lower end, cost-effective hardware. 

While the present invention has been described in relation to specific systems, 
hardware, devices, software, platforms, configurations, process routines, and various 
preferred embodiments, it is to be appreciated that the present invention is not limited 
to any specific embodiments, process, systems, devices, signal formats, data formats, 
and/or configurations. As such, the present invention may be considered to cover any 
and all subject matter, as specified in the attached claims. 
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